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Abstract 

OA ■ We show that when {Xj } is a sequence of independent (but not neces- 

sarily identically distributed) random variables which satisfies a condition 
similar to the Lindeberg condition, the properly normalized geometric 
sum Yl'j=i (where Vp is a geometric random variable with mean 1/p) 
converges in distribution to a Laplace distribution as p — >■ 0. The same 
<~i ■ conclusion holds for the multivariate case. This theorem provides a reason 

' for the ubiquity of the double power law in economic and financial data. 

fi: 

1 Introduction 

^ ■ Let {Xj} be a sequence of independent (but not necessarily identically dis- 

. tributed) random variables and Vp be a geometric random variable with mean 

■ 1/p independent of Xj^s. The geometric sum 



E^^- (1-1) 

naturally arises in diverse fields [Bl, particularly in economics. For example, let 
Wj be the financial wealth of a typical individual at age j and suppose that 
the wealth grows in a multiplicative way according to Wj+i = GjWj, where Gj 
is the growth rate which is a random variable. Assuming that each individual 
■ dies with constant probability p at each period (and a new individual is born) , 

what does the cross-sectional distribution of wealth look like? To answer this 
question, let Vp be a geometric random variable that represents the age of the 
individual. Letting Xj = logG^-i, the log wealth is 

i^p — 1 i/p 
log W,^ = log Wo+Y. log = log Wo + J2 ' 

.7=0 .7 = 1 
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a geometric sum. It might be plausible to assume that {Xj} is independent 
conditional on the realization of macro variables (GDP, interest rate, stock 
market returns, etc.), but since every individual is more or less affected by 
the state of the macroeconomy, it is not plausible to assume that {Xj} (a time 
series) is identically distributed conditional on macro variables. In that case the 
determination of the cross-sectional distribution of log wealth, or the weak limit 
of the geometric sum (|l.ip , becomes a non- trivial problem. 

The weak limit of the properly normalized random sum (jl.ip (where Vp is 
not necessarily a geometric random variable but a general integer- valued random 
variable) has been studied by a number of authors (see [5] and the references 
therein). In particular, when Vp is a geometric random variable and Xj has a 
finite variance, the weak limit of the properly normalized geometric sum (jl.ip 
is a Laplace distribution [TUl [H] , which has been applied to modeling financial 
data [131 M Ej- However, the literature on the asymptotic distribution of ge- 
ometric sums seems to be hmited to the i.i.d. case. [TB] and [5] consider the 
asymptotic distribution of the random sum of independent but not identically 
distributed random variables and provide necessary and sufficient conditions 
for convergence, but since they do not provide explicit examples on geometric 
sums, it is not obvious whether their general theory applies to the specific case 
of geometric sums. In this paper by using a technique similar to the proof of the 
Lindeberg- Feller central limit theorem, I show that the results for the geometric 
sum of i.i.d. random variables extend to the case when the random variables are 
independent but not identically distributed (i.n.i.d.). 

Before proceeding to the main result we introduce some notations. A random 
variable X is said to be Laplace if it has a probability density function of the 
form 

where m is the mode and a, /? > are shape parameters. If a ^ 13, X is said to 
be asymmetric Laplace. The characteristic function of X is 



<j)x{t) = I c'*"^^e^''l"-™lda;+ e**-^^e-"l"-'"lds 
, a + P Jm a + P 



Ami 



^ Q f3 ' a/3 



from which we obtain the mean m+ — — ^ and the variance -ii + 4rr. It is often 
useful to parameterize the Laplace distribution in terms of its characteristic 
function. Let a = ^ — ^ be an asymmetry parameter and a = \J be a scale 
parameter. Then we write X AL{m, a, a) if 



Ox 



it) 



The mean, mode, and variance of AC{m, a, cr) is m + a, to, and + cr^, respec- 
tively. In particular, setting a = /3 = the symmetric Laplace distribution 
with mean and mode to and standard deviation a (which we denote by £(to, cr)) 

has density f{x) = -^^^ ^~ ^ and characteristic function j^-^t^t- A com- 
prehensive review of the Laplace distribution can be found in [7] . 
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2 Main result 



Theorem 2.1. Let {Xj} be a sequence oj independent but not identically dis- 
tributed (i.n.i.d) random variables such that E[Xj] — and Var[Xj] = (t|, Wj} 
be a real sequence, and Vp be a geometric random variable independent of Xj 's 
with mean 1/p. Suppose that 

1. lim n^"(T^ — for some < a < 1 and :— lim > 
exists, 

2. a :— lim — y^'L, a,- exists, and 

n-i-oo " '—'J — ^ 

3. for all e > we have 

lim ^(1 -prVE [X] {\X,\ > ep-^}] = 0. (2.1) 

Then, asp — > f/ie geometric sump^ converges in distribution 

to ^£(0, a, (t). 

By strengthening the assumptions of Theorem 12.11 we obtain the following 
corollaries. 

Corollary 2.2. Let {Xj} be a sequence of independent but not identically 
distributed (i.n.i.d) random variables such that E[Xj] = 0, Var[Xj] = a'j , 
and (j^ := lim — V^'iLi f ? > exists. Let {flj} be a real sequence such that 
a := lim — Y]^^-, a, exists, and Vp be a geometric random variable indepen- 
dent of Xj 's with mean 1/p. Suppose that {Xj^ is uniformly integrable. Then 
P^Y.%i{Xj+p^aj)^AC{Q,a,a) asp^Q. 

Proof. For c > let M{c) = sup^ E[X2 | > c}]. Since is uniformly 

integrable, we have M{c) — ?► as c — oo, so M(c) < oo for sufficiently large c. 
For such c, we have 

o] - E[X| {\X,\ < c}] + E[X] {\X,\ > c}] <c'+ M{c), 

so {(Tj} is bounded, in particular n^^'af^ for any < a < 1. For any e > 
and c > choose p such that ep" ^ > c. Then 



oo 



J2{l-py-'pE [X] {\X,\ > ep-i}] < ^(1 -prVE [Xf{\x,\ > c}] 

< M{c), 

so letting p — and then c — >■ oo, condition (|2.ip holds. □ 

Corollary 2.3. Let {Xj} be a sequence of i.i.d. random variables with mean 
and variance , {aj\ a real sequence such that a :— lim ^ X]j=i % exists, 
and Vp a geometric random variable independent of Xj 's with mean 1/p. Then 
pi Yl'iLii^i AC{0,a,a) as p^O. 
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Proof. Since X,'s are i.i.d., lim - V'Li a"^ — > and is uniformly 

integrable. Hence the conclusion holds by Corollarv l2.2l □ 

The proof of Theorem 12. II is based on the idea of Lindeberg [T^] for proving 
the central limit theorem. We first prove Theorem 12.11 when Xj's are Gaussian. 
Then we take a sequence of independent zero mean Gaussian variables {Yj} with 
the same variances as {Xj} and show that the geometric sums X]J=i("^j + 
p'^a.j) and 'Y^'^^i{Yj + p'^aj) admit the same weak limit. 

Proposition 2.4. Let {Yj} be a sequence of independent Gaussian random 
variables such that Efy,] = 0, VarfY,] = cr? and := lim — V]"^! trf > 

exists. Let {aj} be a real sequence such that a := lim ^ X]j=i ^^'ists, and 

Vp be a geometric random variable independent of Yj 's with mean 1/p. Then 

E%i{Yj + p^ a^) AAC{0,a,a) asp^O. 

Proof Let Sn = J2]=iYn, K = YJj=i'^n, and = <^n- Since Y,'s are 

independent Gaussian, Sn ^ X{0,t^). By conditioning on i/p the characteristic 
function of the geometric sum Zp :— p^ 'Yl'i=i0^j ~^ P^^j) is 



oo 



Let z„ = —it^ + "2^- By assumption, z„ — > z := —iat+ as n — >■ c». Since 
Rc z = > > — 1 , by Lemma IA.3[ we obtain 



lim (t>p{t) 



1 



P'-^'Q^"" l + z i-iat+^' 

Hence Zp ^ AC{0, a, cr) as p — > 0. □ 

Next we show that condition (|2.ip holds for {Yj}. 

Lemma 2.5. Let everything be as in Theorem \2.1\ and {Yj} be as in Proposition 
\2.4\ Then condition (12. ip holds for {Yj}. 

Proof. Since n~°'a'^ for some < a < 1, for any J > we can choose N 
such that n~"(T^ < 6 ioi n > N. Since by assumption Yj ^ N{0,aj), we have 

Z = Yj/cTj - A^(0, 1). Let 7? = ^ > and c = ep-^. Since |Y,/c| > 1 when 
\Yj\ > c, for j > N we obtain 

E [Y^' {\Y,\ > c}] < E [Y^' \Y,lc\^ {\Y,\ > c}] 

2+r, 

<E[i^2|r,/c|"]<^Epr''] 

< ^^it^ mf^'] = n\zn (2.2) 
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where we have used = by the definition of 77. Substituting c ^ ep 2 ^ 
multiplying (j2.2p by (1 — pY^^p and summing over j > N , it follows from 
Lemma IA.4I that 



^ {l-py-^p^[Yf[\Y,\>ep-'^] 



]=N+1 



1 — p ^-^ 

t A — AT I 1 



3=N+1 



R r— !— • — 

e'' 



£[1^1^+"] 



e"(l-p) 

for some constant C > 0. Hence 

00 



e"(l-p) 



E[|Z| 



TV 

<Y,{l-py-'pE[Y^'{\Y,\>ep-^} 



E[|Z| 



2+rn 



Letting p — > and then (5 — > 0, condition (12.11) holds for {Yj}. 



□ 



Proposition 2.6. Let {Xj}, {Yj}, {aj}, and Vp he as in Theorem \2.1\ and 
Proposition \2.4\ Then for any bounded function f onM. with bounded deriva- 
tives up to the third order, we have 



lim 



Proof. Fix n and consider 

n 



= 0. 



(2.3) 



where 



By Corollarv lA.6[ the j-th term of (|2.3p is equal to 



where i?j is the remainder term. Rj is bounded by 

\R,\<g{p^X,) + g{piY,), 



p{X -Yf) + R,, (2.4) 



(2.5) 
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where g{h) = K min for some K > 0. Noting that Xj, Y.j are indepen- 

dent of Zj, E[Xj] ~ E[K,] = 0, and Var[Xj] = Var[lj] = a^, taking expectations 
of both sides of (|2.4p , we get 



nf{pHx, + z,))] - nnpHY, + z,))] < e[\r,\]. 

Therefore by the triangle inequahty and (I2.5p we obtain 

n n 



< 



(2.6) 



Using the definition of 5, we can bound 'E[g{pi Xj)] as 

E[g{pix,)] = E [g{pix,) [\X,\ < ep-i}] + E [g{pi Xj) [\X,\ > ep'i] 



< KE 
= KE 



p^X,\' {\Xj\<ep-^} 
{p^X,)h[\X,\<ep-^] 



KE 
fXE 



< eKpa^ + KpE 



Xf[\X,\>ep-i} 



ip'^X,r{\X,\>ep-i} 

ip^X,)'[\X,\>ep-^} 
(2.7) 



Now let r,^ = J2]^=i '^j- Since T^/n ^ ct^ by assumption, {r,^/n} is bounded by 
some M > 0. Then 



^(1 -p)""VE'^-^^'^i - ^i^-pY'^^P'^KpMn = eXAf. 



(2.8) 



n=l 



5^ 5^(1 -p)"- We 

j = l n=j 



Also, by changing the order of summation we obtain 

00 n 

J2{i-pr~'pY,KpE [X^ {\X,\ > ep-i} 

'x][\X,\>ep-i] 
X^{\X,\>ep-i}' . 
Combining ((2J)) . ((2^ . and ((2J)) . we obtain 

00 n 

^(l-p)"-VEE[.9b^^.)] 

CXD 

< /s:Me + X^(l -p)J-VE X| > ep^^l . (2.10) 



i^^(l-p)^-VE 



(2.9) 



n=l 
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The same inequality as (|2.10p holds when {Xj} is replaced by {Yj}. Hence 
applying condition (|2.ip to (|2.10l) and invoking Lemma [^751 it follows from (|2.6p 
and ^JU\i that 



-E 



-E 



< ^(1 - pr-'p |e [/(p^ E:Li(^. 

n=l 

oo n 

< -?')""'pE {mP^X,)]+E[g{p^Y,)] 

n=l j^l 

oo 

< 2KMe + K^{1 - py-^p (e > ep-^j 
^ 2i^Me 

as p — 0. Since e > is arbitrary, letting e — we get 



E 



i;^{|r,|>ep-^}]) 



lim 

p->0 



E 



/(P^ - E \f{p^ T.7=,{Y, +pha,)) 



□ 



Proof of Theorem \2.1l Let /(a 



/ is C°° and all of its derivatives are 



bounded because = |(ji)"e**^| = i", which does not depend on x. Let 

{Yj} be as in Proposition 12.41 Then by Proposition 12.61 we get 



lim 

p-¥Q 



E 



E 



= 0. 



Hence by Proposition 12.41 we have 



lim E 



= limE 



1 



1 — iat 



Since the right-most expression is the characteristic function of ^£(0, a, a) which 
is continuous at t = 0, by Levy's continuity theorem pa 'Y^'^^i{Xj + p^aj) con- 
verges in distribution to ^£(0, a, cr) as p 0. □ 



3 Multivariate case 

The generalization of Theorem 12.11 to the multivariate case is straightforward. 
If X is a d-dimensional random variable with characteristic function 

where m,a E and S is a d x c? symmetric and positive definite matrix, then 
the distribution of X is said to be multivariate Laplace which we denote by 
ACdim, a, S). The mean, mode, and variance of ACdim, a, S) is m + a, m, 
and S -|- aa', respectively. 
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Theorem 3.1. Let {Xj} he a sequence of independent hut not identically dis- 
tributed (i.n.i.d) random vectors in such that E[Xj] — and \ai\Xj\ = Sj, 
{dj} he a sequence in , and Vp he a geometric random variable independent 
of Xj 's with mean 1/p. Suppose that 

1. lim n^"S„ = O for some < a < 1 and S :~ lim — exists 
and positive definite, 

2. a := lim — y^"_i a, exists, and 

n-i-oo " '—'J — ^ 

3. for all e > we have 



oo 

lim ^(1 -prVE [||X,||^ {||X,|| > ep-^} 



-0, 



(3.1) 



where \\-\\ denotes the Euclidean norm. 

Then, asp ^ the geometric sum pi 'Yl'j'LiiXj+pi a,j) converges in distribution 
to ACdiO,a,'E). 

Proof. Let us first show that for any 7^ t G M"^ the sequence of real random 
variables {t'Xj} satisfies the assumptions of Theorem 12.11 Since E[Xj] = 
and Var[Xj] = Sj, we have E[t'Xj] = and Var[t'Xj] = fE^t. Hence 
lim n^" Var[*'X„] = and 



1 " 

lim - V Var[t'XA = t'T.t > 



because S is positive definite and t 7^ 0. Also, lim — y)"^! t' aj = t' a. By the 
Cauchy-Schwarz inequality, we have \t' X\ < \\t\\ \\X\\. Hence 



{\t'X\>c}c{\\t\\ ||X||>c}= ||X||> 



Therefore for all e > we have 



oo 

J2{l-py-'pE [{t'X.f {\t'X,\ > ep-i} 



<\\tfY.ii-py-'pE 



\x,r\\\x,\\>—p- 



as p — > by condition p.ip . so {t'Xj} satisfies condition (|2.ip of Theorem 12. II 
Since {t'Xj} satisfies all assumptions of Theorem 12. 1[ it follows that 



t'pi '^{Xj +piaj) = p5 ^[t'Xj +pit'aj) 4 A£{0,t'a, VFsi) 



as p — > 0. This shows that 

hmE e't'p'2:;£i(^.+P*«. 



1 - it'a+ ^t'Tit 



(3.2) 
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In proving p.2p we have assumed that t ^ 0, but p.2p trivially holds for 
t = 0. Since the right-most expression of p. 21) is continuous at t = 0, by Levy's 
continuity theorem 

Up 

□ 

4 Concluding remarks 

In this paper I showed that the properly normalized geometric sum X^J^i -^i 
converges in distribution to a Laplace random variable even if the random vari- 
ables {Xj} are not identically distributed as long as they are independent. The 
proof is similar to that of the Lindeberg- Feller central limit theorem. This the- 
orem provides a reason why many economic and financial variables obey the 
power law not just in the right tail [2] but also in the left tail. If an economic 
variable results from a large, deterministic number of independent multiplica- 
tive shocks, that variable will be lognormally distributed as first observed by 
[3]. However, in reality many variables seem to be well-described by the double 
Pareto and related distribution [HJ [13 SI [T71 [T] . If we incorporate the death 
probability of economic units in the model, the number of multiplicative shocks 
is not deterministic but a geometric random variable. Theorem 12.11 (in expo- 
nential form) then states that the geometric product of independent positive 
random variables tends to the double Pareto distribution, which is empirically 
supported. 

Since the central limit theorem holds under general conditions (for exam- 
ple, ergodicity and stationarity) , we can expect that the properly normalized 
geometric sum of random variables converges in distribution to a Laplace distri- 
bution under such conditions even if independence fails. Addressing these issues 
are beyond the scope of this paper but interesting to pursue. 

A Lemmas 

Lemma A.l. For z £ C, we have — 1| < \z\ e'^' . 
Proof. Using the Taylor expansion of e^ , we obtain 

|e^-l| = 

□ 

Lemma A. 2. For < p < 1 and x > —1, we have < (1 — p)e~'P^ < 1. 

Proof. Since e* > 1 + t for all t, we get e^^ >l+px>l— p>0. The first 
equality holds if and only ii px = and the second if and only if a; = — 1, 
but since < p < 1 the two equalities cannot hold simultaneously. Hence 
< (1 -p)e-P^ < 1. □ 



Tl=l 



OO |^|n 
n=0 ^ ' 



n=0 
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Lemma A. 3. Let < p < I and {zn} C C be such that lim 2„ = z with 

n— ^oo 

Re z > — 1 . Then 



P^O'^ 1 + z 



n=l 



Proof. For < p < 1 let S{p) = - p)"" ^e-P"^". First we prove that 

S(j)) exists. For this purpose let z„ = Xn + iyn- Since lima;„ > —1, we can 
choose iV > such that x„ > — 1 for n > N. Then by the triangle inequality 



N 



Ed 


-pT- 


-ipe-P"x„ 


+ E (1 


n=l 








N 






oo 


Ed 






+ E (1 


n=l 






ri=JV+l 


N 








Ed 

n=l 









- (1 - p)eP 



because < (1 — p)e'' < 1 by setting a; — —1 in Lemma rA.2l Hence S{p) exists. 
Replacing {z„} with z and applying the same argument, 



pe 



n=l ^ ^' 

exists. Now by I'Hopital's rule we have 

lim T(p) = lim ^ = lim 



P^o p-)-o eP^ - (1 - p) p^o zeP^ + 1 1 + z ' 

so it suffices to show that — T(p)| — > asp — > 0. For any < e < 1 + Rez, 
choose > such that |2„ — z| < e for n > A^. Consider 

N 



\s(p)-T{p)\<Y^{\-pr-^p\e- 



^ (l-p)"-V|e"P"^" -e-P"^| =/ + //. 



ra=A''+l 



Since each term of and tends to zero as p — > 0, we have / — > 0. By 
the choice of N and Lemma lA.ll letting z ~ x ^ iy we get 



n=l 
oo 



,pn|z„-z| 



n=JV+l ri=JV+l 

Since Rez — e > —1, by Lemma FA. 21 we have (1 — p)e^P^^^^^ < 1, so the above 
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sum converges. Then 



-1 -pri(x-e) 



n=N+l 



= e 



gp(a;-e) — 1 -)- ■ 



^„-p(JV-i)(z-6) 



(l + x-e)2 



as p ^ by applying I'Hopital's rule to the above fraction. Letting e ^ 0, we 
obtain // 0. Hence lini5'(p) linir(p) = j^- □ 

Lemma A. 4. If < p < 1 and a > —1, there exists a constant C > such 
that 

oo 

^(l-}j)"n" < Cp-'^-\ 

n=l 

Proof. Let f{x) = (1 — p)^x". If — 1 < a < 0, f{x) is monotone decreasing for 
X >0. Since log(l — p) < —p, we obtain 



POO 

V (1 - p)"n" < / (1 - pfx'^dx = 



r(a + i) 



< Cp 



-a-1 



/o (-log(l-rt)«+i 
where C = r(Q; + 1). If a > 0, again using log(l — p) < —p we have 
fix) = [a + log{l-p)x]{l-pfx°'-^ <0 



for a; > -. Hence we obtain 

— p 



n<a/p n>a/p 



n 



n=l 



< 



r(a + 1) 



a+1 



(-log(l-p))"+i 



where C = a"+i + r(a + 1). 



□ 



Lemma A. 5. Let f be a hounded C'^ function on M with bounded derivatives 
up to the third order. Then there exists a constant K such that for all /i e M, 
we have 



g{h):= sup 



f{x + h)-f{x)-nx)h--f"{x)e 



< i^min 



{h\\ht}. 



Proof. By assumption Mj := sup^^gR < oo for i = 0, 1,2,3. By Taylor's 

theorem for each x, x + /i e M there exists ^ between x and x + h such that 

fix + h) = fix) + f'ix)h + -f"ix)e + ^—^h\ 



Hence 



fix + h)-fix)-f'ix)h--f"ix)h^ 



<^\ht =:K^\ht . 
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On the other hand, by the triangle inequaUty we get 

1 



f{x + h)-f{x)-f{x)h-^f"{x)h' 



< 2Mo + Ml \h\ + ^ < K2 \h\^ 



for large enough \h\, say \h\ > b. Then ioi \h\ < b we have 



f(x + h)~fix)-f'{x)h~-f"ix)h' 



< Ki \h\^ < Kib\h\^ . 



Hence by taking K = ma.x{Ki, K2, Kib} we obtain 



f{x + h)-f{x)~f'ix)h^-f"ix)h^ 



< K lam 



m[h',\h\'} 



□ 



Corollary A. 6. Let everything be as in Lemma ] A. 5\ Then 

fix + hi) - fix + h2) = fix)ihi - h2) + ^^{hj - hj) + R{x, hiM), 
where the remainder term R satisfies 

huh2)\ < g{hi) + 5(/i2) < K [min j/i?, + min [hi, |/i2|'} 

Proof. Trivial by Lemma IA.5I and the triangle inequality. 



□ 
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